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Abstract 



Developing^ Models 



The purpose ofj this paper is tc> discus*^ a numt)er of conceptual « 
statistical and mttHodologlcal considerations which have an Important 
btaring on the development of an einplrlcaiiy*l>esed model of communicative 
competence (CC). First, the notion of components of CC is examined and 
m distinction is made tietween descriptive and working models of CC. 
Stcond, statistical a^ methodological considerations are dlKussed« includ- 

i 

Ing issues ralated to Interpreting correlation coefficients, norm^referenced 
vs. crlterion*referenced measurrnent of language skills, and tht language 
background of language iearnei:s included in empirtoai studies of CC. 
Third, some Important studies on the :omponents of CC are reviewed and 
their findings reinterpreted in light of these cons derations. Finally, 
topics and guidelines for fUrther needed empirical research In this area are 
offSired. 
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Developing Models of Communicative Competence: 
Conceptual. Statistical, and Methodological Considerations 

Over the last several years, a good deal of thought and research has 
bitt\ concerned with the probletn of discovering the linguistic and extra- 
Utigulstlc abilities which make up cofr^nunkatlve competence (CC), I.e., the 
al lllly to communicate effectively and appropriately In a given language In 
vjTlous situations. While there now appears to bm general agrea.ient 
ariong applied linguists, soclollngulsts, and psychollnQulsts that far more 
ttan grammatical knowledge or competence Is required for CC, there has 
b< en a continuing debate between proponents of a model of CC whfch puts 
?IlPjj^''V general factor of CC (e.g.. Oiler, 1J76; Oiler S HInofotIs, 
r»80) and those who maintain that a number of distinct components must b« 
Ir eluded In a valid model of CC (e.g., Bachman S Palmer, 1M2; Canale % 
SWaIn, 1910: Cummins, 1981). However, apparently lost In this debate are 
a number of Important conceptual, statistical, and mtthodologlcal considera- 
tions. 

The purpose of this paper Is to bring to light a number of these 
considerations and to discuss their Impllcattons for Interpreting both theo- 
retical and empirical work In this area and for planning additionally needed 
empirical research. First, the notten of components of CC Is examined and 
a distlnctton Is made between descriptive and working models of CC. 
Second, a number of statistical and methodok>glcal considerations are 
discussed which have a crucial bearing on the Interpretation of tmplrtoal 
research on working models of CC. Third, several Important studies on 
the components of CC are reviewed and their findings reinterpreted In 
light of these considerations. Finally, topics and guidelines for further 
needed empirical research In this area are offered. 

Components and Factors of Communicative Competence 

Central to the development of models CC Is the notion of compo- 
nents of CC. Essentially, most theoretical and empirical work In this area 
has been concerned with defining what the components of CC are and 
describing how these components are Interrelated. However, there are two 
very different ways of going about this task. Depending on one's per- 
spective and purpose, one may wish to consider the components of CC to 
be representative of all the knowledge and skills necessary to communicate 
effectively and appropriately In a given language. In contrast, one may 
be instead Interested In determining how many psychologically Independent 
or orthogonal types of knowledge or skills make up CC. Since the statis- 
tical technique of factor analysis has commonly t)een used to detehnlne how 
many statistically uncorrelated components account for the variance of a 
group of subjects on a large battery of psychological measures, factors will 
be used In this paper to refer to components or combinations of compo- 
nents cf CC which are statistically Independent (uncorrelated) for a given 
group of language learners. On the other hand, components will refer to 
any types of knot^rledge or skills which appear to 'be involved In CC In a 
given setting, whether or not these sources of knowledge are psychologic- 
ally or statistically Independent of each other (I.e., form separate fac- 
tors). Failure to keep this distlnctten clear between components and 
f^c^o^'s of CC appears to be responsible for much of the controversy and 
confusion which currently exists In this area. 
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The former perspective of descrlb;.ig and defining all of the compo- 
nents of knowledge and skills that a person needs to communicate effec- 
tively and appropriately In a given language can be described as develop- 
ing a descriptive model of CC. The most wMely known current descriptive 
mode or CC appears to be that developed by Canalf/ t Swain (1910) and 
C«nale (In press). In this descriptive model, CC Is divided Into four 
principal types of competence, vli., grammatkal, soclollngulstic, dis- 
course, and strategk: competence. For a descriptive model of CC, what Is 
of primary concern Is the Induskm of all typ^s of knowledge that are 
necessary to be successful In communkating via language and making sure 
that the model's components are organised Into a logkal and Intuitively 
appealing structure. Thus, while Canale and Swain (1910) first Included 
discourse competence as a part of sockflngulttk competence, Canale (In 
press, now consklers discourse competence to be distinct from aoclollnguls- 
tte competence and worthy of separate billing, fresumabty this change 
was not tiased on findtndt from empirical research and does not necessarily 
suggest that socMlngulstk and diKourse competence are separate or 
Independent In tny statlstkal or psychotogkal tense, but sNnpiy points out 
that for deKrIptlve models of CC, dexribing components and their Inter- 
relationships Is primarily a problem of deflnltkn. 

In contrast, wprklnq models of CC attempt to show how com^nents of 
CC are Interrelated psychokgkally to form a set of Independent factors. 
Of principal Interest from this perspective Is to determine whether the nne 
divisions whkh linguists and soclolingulsts use to describe language (e.g., 
phonological, nwrphologlcal, syntactk? discourse, and soclollngulstk rules) 
are psychologically distinct so that a language learner can learn them 
separately or learn more of one than of another. This, then. Is an em- 
pirical c|uestH>n, answerable only by carefully designed and Implemented 
research. While a fair amount of this type of research has been done, 
(see, e.g.. Oiler, .1971: Oiler % Hinofotis, 1910: BKhman S Palmer, 1982), 
there Is still considerable debate over the findings and their Interpretation 
(see Oiler, 19i1). Before this research Is reviewed, however, there Is a' 
need to describe the bask research methodology used In this type of 
research and the problems Inherent In Interpreting the results of such 
research, in fKt, there appear to be some very bask statlstkal and 
methodok>gkal considerations whkh have been Ignored In designing these 
studies aiKl Interpreting their results. 

Statistical and Methodological Conslderattens In Developing Emplrkally 
Based Working Models of communfcatlve Competence 

Interpreting the Pearson Product-Moment Correlatten Coefficient 

It appears that all of the research designed to Investigate the factors 
of CC and their Interrelations have been correlatknal In ,nature. To 
Illustrate, let us take a simple example of a study that might be done to 
Investigate the relationship between Engllsh-as-a-second-fanguaoe (ESt) 
reading and speaking skills Involving 100 foreign students studying at an 
American university. The primary question to be examined Is whether 
reading and speaking skills are related (I.e.. a student who Is strong In 
reading Is also strong In speaking while a student who Is weak one skill Is 
also weak In the other) or Independent (I.e., knowing that a student Is 
strong or weak In one skill does not allow one to Kcurately predkt ability 
In the other skill). To answer this question, a researcher would typkally 
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locate (or construct) tests o^f English reading comprehension and speaking, 
administer them to the group, and calculate the Pearson product-moment 
correlation coefficient to descrlt>« the degree of rela^Uonshlp of scores on 
the two /tests. If the. correlation Is high (.7 or akwve), a typical re- 
searched would likely* conclude that the%e two sKllls of English CC are 
highly related, while If the correlation coefficient Is/ low (>4 or below) he 
Is likely to conclude that the two skills are relatively independent of each 
other. However, there are a numt>er of Important considerations which 
should be kept in mind before coming to these conclusions. I 

Hrst of all, while a low correlatk>n coefficient fmay well Indtoate that 
there Is little If any relationship between the two skills under study, tHe 
opposite Interpretatton Is also possible. Since thW correlation coefficient 
tells us how much of the variance on one test Is /predicted or accounted 
for by variance on the other test, the amount of fnterlndlvldual variation 
on each test also Influences the value of the correlation coefficient. There- 
fore, if all of the students In our group score uniformly high on t>oth 
tests, the value of the correlation coefficient may/be quite low In spite] of 
the fact that no student scored high on one test and low on the other. 
Conversely, while a high correlation coefficient may well Indicate that there 
Is a strong relation between reading comprehensk>n and speaking skills, 
the opposite Interpretation may also make sense. jThls could be' the case If 
the students ranged from educated native-speaker proficiency down to an 
Intermediate level of proficiency In reading comprehension while they 
ranged from an Intermediate level down to virtually no proficiency In 
speaking English. The fact that each student Is; notably weaker In speak- 
ing ability wf^uld suggest that the two skills are not highly related In the 
strongest sense of the word and that one general language proficiency 
factor wo'jid not adequately explain the performance of these students. 

Yet, even with most students performing notably worse on the/ mea- 
sure of speaking ability, there may still be » high correiatkin coefficient 
between reading and speaking skills since the coefficient Is based on 
relative performance of each student compared to his group and not on any 
absolute or criterion-referenced level of language proficiency. This brings 
Into question the exclusive use of norm-referenced tests for this type of 
research and suggests that the use of criterion-referenced language tests 
^^'hich yield scores whkh are meaningful In terms of known levels pf lan- 
guage proficiency may be more appropriate (see Cziko, 1911 and In press). 

language Background 

Another factor which must be considered lo the Interpretation of the 
results of language tests Is the type of English-language background 
shared by the subjects under study. English-language background refers 
to the type of contact the subjects have had with the English language and 
the amount of opportunity they have had for acquiring the various skills 
and components of English CC. This background can vary tn three basic 
ways which are portrayed by the patterns shown in Table I. In these 
patterns, points toward the top of each k>and represent Individuals with a 
high degree of exposure to a given language skill while points toward th? 
t>ottom of each band represent Individuals with a low degree of exposure to 
a given language skill. Lines connect the same Individual's position In the 
two language skills portrayed (I.e., reading and speaking). While the 
language background patterns of Table I include only seven out of many 
more possible patterns, only four Individuals per group, and exposure to 
only two language skills extensions to other patterns, larger groups, and 
more skills could be easily made. 

/ 
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The first way In which ■ group's language background pattern may 
vary Is In the degree of homogeneity of the group with respect to the 
amount and type of exposure they have had to each of the ESU skills 
under conslderatfon. For example, the only exposure that a group of 
foreign students may have had to English t>efore coming to study In the 
U.S. could have been that provkied by a series of formal courses taught 
at the secondary school and university undergraduate levels. If all of 
these students had taken the tame or very similar courses, then they 
would be very homogeneous In terms of their exposure to English and It 
could be said that they have low wlthln-sk 111 variance In their exposure to 
those ESL skills they had had the opportunity to acquire. This low de- 
gree of withln-group varlatton Is shown In the patterns of Examples 3, 4, 
5, and 7 of Table 1 where there Is relatively little vertical spread among 
the four points for each language skill. If, on the other hand, the group 
consisted of students who were very heterogeneous with .respect to their 
exposure to one or more ESL skills (e.g., some had gone abroad for a 
yjbir to study at a British or American university while others remained 
home and took only a few English courses) they would then be character- 
ised by high withln-sklll variance In one or more ESL skills, Groups with 
■ high degree of wlthln-sl'"l variation In exposure to ESL language skills 
are shown In the pattttrns of Examples 1, 2, and € of Table I where there 
Is a large amount of vertical spread among the four points for the two 
language skills. To keep TatHe 1 relatively simple, not shown are groups 
characterized by a high degree of withln-sklil variation In exposure to one 
skill and kiw withln-sklll variation In exposure to another skill. 

Insert Table 1 about here 



Second, a student may have had the type of exposure to the English 
language whkh fostered the development of all of the components which 
make up English CC. Such a background could be provided by a foreign 
school or university which has a strong English program, requires stu- 
dents to take courses In their area of study using English as the medium 
of Instruction and discussion, requires students to study from English 
texts, and provides contact with native speakers of English via student 
exchanges or programs of study abix>ad. In contrast, the only English 
courses another student may have had could have been concerned solely 
with the development of skills for reading technical, scientific English. 
Hence, a student may have a very even or uneven exposure to the various 
components which are believed to be important to CC. A person with even 
exposure to these components will be referred to as having tow between- 
skill variance In E3L t>ackground. Groups made up of such individuals are 
shown In the patterns for Examples 1, 3, and 5, of Table I. Low betwecn- 
sklll variance In exposure to the skills of reading and speaking Is shown 
In these patterns by the low slope of the lines connecting the points 
(representing the same Individuals) In the two language skills. In con- 
trast, groups comprising Individuals characterized by high t)etween-skill 
variance In exposure to the two language skills are portrayed by points 
connected by lines having high slopes In Examples I, 4, 6, and 7 of Table 
1. 

Finally, the relationships of exposure to ESU across different skills 
may vary considerably from group to group from strong positive correla- 
tions through weak or close to xero correlations to strong negative correla- 
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tlons. For example, a group of students may have the option of taking 
English courses for one. two. three, or four years with all courses de- 
signed to develop both reading and speaking skills. In this case there 
would be a strong, positive correlation between exposure to English read- 
Irig and speaking skills since those students who study English tenger will 
qc more exposure to both skills. The resulting language background 
pattern would be that described In Examples 1. 3. 6 or 7. depending on 
the amount of wlthln-sklll and between-sklll variance In exposure to the 
two skltts. Conversely. If the students had available a large variety of 
L I^P"'ar English courses, each one with a different skill focus. 
Uicn there would be a low correlation between amount of exposure to 
dITferent English language skills resulting In language background patterns 
simlar to those of Examples 2. ^. or 5 of Table 1. Although negative cor- 
rections are also possible and Indeed likely for certain groups of subjects, 
they are not considered In Table 1 for reasons of economy. Table 1 
therefore, represents |ust seven of a much larger number of possible lan- 
Ouoge background patterns whteh can result from combinations of the 
above three aspects of within- and between-sklll variance in language 
background and the correlation of exposure between language skills. 

Now that these three aspects of language background have been 
described, let us examine how one of these may Influence the Interpreta- 
tion of the data in our example, ff our 100 foreign students have a high 
positive correlation In amount of exposure to opportunity to acquire 
English reading and speaking skills (as in Examples 1 or 6). we should not 
be surprised to find that there is a fairly high correlation between their 
reading and speaking test scores. This would not necessarily lndk:ate 
however, that the two skills are dependent on each other or are simply 
two manifestations of a unitary underiyina language ability. Those stu- 
den^ who have devoted more time to studying English would be expected 
to do better In both reading and speaking than those who have had less 
time for English study If their English study had given them- exposure to 
both skills. If. on the other hand, we find a low correlation between 
reading and speaking test scores for this same group, this would seem to 
Indicate that reading and speaking are In a very real sense separate 
languaae skills. Such a finding would suggest that we could not predict 
English reading ability based on observed ability to speak English and that 
teaching one skill would not necessarily Influence the other. 

Let us now consider a group for which there Is no correlation In 
exposure between the skills being measured, as In Example 2. I. or 5 of 
Table 1. If for this group we found a low correlation between language 
skills It would seem to make most sense to attribute this to the language 
background of the group and not to any psvchok>glcal|y real Independence 
of the language skills under consideration. If. however, we find a high 
correlation between reading and speaking skills, this would appear to 
provide Impressive evidence for the Interdependence of these two language 
ground interdependence which as not an artifact of language back- 

Although we have only considered the correlation in exposure between 
hnguage skills in interpreting the results of language test score patterns, 
both within- and between-skiii variance in exposure to language skills also 
should be considered In making these interpretations. However, a dis- 
cussion of these factors will be more meaningful after the concepts of the 
next section are introduced. Nevertheless, the general point being made 
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language tests administered to group of second-language learners can only 
^Lrn'" "^ ""j; Inttrpreted In light of the languSge^kground ofThe 
ofT^t't rr«!iiM ^1'!S"k*'"^ solely on the pattern of test results, patterns 
o thl or«m 'i^li? ST^'fu ''^^^ Jinguage background pattern 
of the. group. If this Is done, then we may will find that what Is often 
?r • one-factor or multi-factor working model of 

nri nr^ '"'^""^ ^ ^^^^^ !"<^'"tlon that the pattern of language pro^ 
nciency on< .^qtJlres Is related to the type and ai^nt of expowre to thi 
language one has had. If, however, it Is found that the pattern of test 
results Is not congruent with the language liackground pattern of a group, 
this woul<r-Then appear to be ImporUnt ivldence for the psychological 
reality of the model which best txpltlns the test result pattern. 

Patterns of tjinguaga Proficiency 

We now need to consWer how language skill proficiency patterns can 
vary across groups of language learners. As for the language V)ackground 
patterns described above, patterns of language proficiency can vary In at 
least three basjc ways; examples of seven possible patterns of language 
proficiency involving the two skills of reading and speaking are given In 
the column headed "True SkHt Pattern" of Table 2. The patterns of this 
column are analogous to those of Table 1 except that the vertk:at dimension 
now represents language proflcttncy level. Points at the top of eKh band 
represent Individuals with language profklency equivalent to that of a 
we -educated native speaker of the language while points at the very 
bottom of each band represent Individuals with no proHclencv In the lan- 
guage skill under consMeratton. 



Insert Table 2 about here 

The first way In which language proficiency patterns can differ 
across groups of Individuals Is In the amount of withln-skili variance In 
pronclency in given language skills. A homogeneous group with respect to 
anguage proficiency would have little withln-sklll variance In proficiency 
In languige skills. Patterns characterlilng such homogeneous groups are 
shown In Examples 3. 5. and 7 of Table 2. in contrast, more hetero- 
cieneous groups characterlied by high withln-sklll variance In language 
pronclency are shown In Examples 1. 2, and I of this table. 

A second way In which language proficiency patterns can differ Is In 
the amount and directton of correlation between language skills. This cor- 
relation, usually quantified by use of the Pearson product-moment correla- 
tion coefficient, can vary from dose to negative unity (Indicating a strong 
• nverse linear relationship) through lero (Indkating no linear relattonship) 
to close to positive unity (Indicating a strong positive linear relationship). 
For the sake of brevity, only patterns characterlted by strong positive 
inear relationships (Examples 1. 3, 5. and 7) or linear relationships close 
to tero (Examples 2. and 5) between the two language skills are In- 
cluded In Table 2. although It Is possible that an Inverse relationship 
8kli?s* * correlation) could exist between proficiency In two language 

Finally, we need to consider the amount of between-sklll variance In 
proficiency between language skills. In Table 2. this Is Indteated by the 
amount of slope of lines connecting Individuals*" proficiency levels across 
the two skills of reading and speaking. Thus, In Exampli^s 1, 3. and 5 




there is little or no betwetn-sklll variance while for Examples 2» and 
7 the t>«tween*sklti variance in proficiency between reading and speaking 
is considerable, if measures were used which reflected Individuals* true 
level of proficiency on language skills from fro, representing no proflcl* 
ency* to »ome arbitrary fixed maximum* representing the proflctency level 
of an educated native^ speaker of the language » then true between-sklll 
variation in language p'roricl'ancy between two skIIIs could t>e mathematkally 
defined 4% the sum of/ squares of the differences between eKh Individual's 
pairs of scores on the two skills divided by the numt>er of Individuals In 
the group. j 

This cotKept of (true between-sklH variance In proficiency in language 
skills would appear to be of critical Importance In determining the number 
of factors underlying the CC of a group of language learners. For in* 
stance* if our group ofr learners showed high between*skiil variance be- 
tween skills In English reading and speaking (as In Examples 2, 1» and 
7 of Table 2} it would appear th«t ■ one'factor Interpretatton of the pat- 
tern Is Inadequate since It fails to take Into account the fact that natlv4" 
speaker level prol^lclency in reading Is not uniformly associated with 
n«itlve-ipeaker proficiency in speaking. Conversely » low wlth<n-skiii 
variance between language skills (as In Examples 1, 3, and 5 of Table 2) 
would appear to support a one-factor Interpretation since the profkSency 
iQvet of each Indi^^lduat would be approximately the same In tach of the 
language skills, j 

Criterion- and Norm- Referenced language Measures 

While this ^^dlscusslon of true skill language patterns has obvious 
Importance for d^eveloplng models of CC» It must be realUed that completely 
valid Information concerning the true skill proficiency patterns of a group 
of language learners Is never possible to obtain. Instead we must build 
our theories apd models using the Information provided by measures of 
language proficiency* all of which Introduce error Into our assessments of 
language proficiency levels. There are» however » tome important differ- 
ences between^ criterk>n-referenced (CR) and norm- referenced (NR) mea- 
sures of language proficiency with respect to the type of Information they 
can provide concerning the true skill proficiency pattern of a group of 
language tearfiers. 

For the purpose of this discussion* a CR measure of language pro- 
ficiency wilt be considered to txi one which yields scores which are directly 
Interpretable In terms of a language performance standard (sej Cxlko» 
XW, p. 32). Examples of such measures are the oral Interview and 
reading test's originally developed by the Foreign Service Institute (FSI) of 
the Department of State (see Jones* 1979) and now administered by the 
Interagency^ language Roundtabte (IIR) as well as the ESI dktatlon test 
andcopytest developed by Cilko (In press). These CR lanquage measures 
contrast with NR measures of language proficiency whicn yield scores 
which are/jiot Interpretabte In themselves » but rather must be converted to 
a standard score or percentile rank which la effect compares an individu- 
al's scor4 with the scores of ail other examinees (usually other second 
languageMearners) on the measure. Examples of such NR measures are 
the Test of English as a Foreign language (TO£Fl) developed by the 
Educational Testing Service and typical applications of Integrative testing 
procedures such as the close and dictation procedures when the tests are 
not calibrated with respect to a specific criterion group of language users. 
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This distinction t>etween CR and NR language measures Is of critical 
importance whenever one attempts to determine the true skill proficiency 
pattern of a group of individuals based on their performance on language 
measures. Since CR measures are designed to yield scores whk:h are 
Interp re table with respect to a speclHed language performance standard 
(e.g., educated native speakers of the language), reliable and valid CR 
measures of language skills could be expected to yield a pattern of test 
scores whkh are useful appro xlmatkNis of the underlying true skill (.rofl- 
ctency pattern of the group being studied. Ihus, If our group of lan- 
guage learners all scored between 4 and on the ILR test of French 
reading but between 0 and U on the ILR French oral interview, this 
group's true skill pattern for reading and speaking French «i!d likely t>e 
similar to ttie true skill pattern shown In either Example ^ or 7 of Table 2 
(the exKt pattern depending on whether or not a high correlation was 
observer! between the two measures), Nowever, since tor NR tests a 
group's mean score as well as Its wlthln-test varlatk>n are typkally con- 
sidered arbitrary « the scores resulting from such measures are usually 
standaro'^ve;^ so that the mean and variation Is made to equal certain pre* 
spKlfied values. The most common standa^^lltatkm procedure Is the x 
transforr,»atkm whkh linearly transforms raw test scores so that their mean 
Is equal to zero and their standard deviation and variance are equal to 
unity, it should be noted that this standardixatlon procedure Is Involved 
whenever the Pearson correlation coefftctent between two measures Is 
cakutated, as is done for all statlstkel procedures besed on the general 
tkiear model such as regresskm analysts and factor analysis (both explora- 
tory and confirmatory). 

This standardixatlon of the mean and variance of a set of test scores 
has two Important effects on the type of NR t<st result patterns that one 
can obtain. First, NR tests and correlatk>nal analyses standardixe the 
wlthln-test variance so that regardless of the true withln-skill variance the 
amount of adjusted wIthin-test variance Is the lame for tach .language test^ 
Consec^uently, as shown In Table 2, the differences betwe^nn true s'^tll 
patterns of Examples 1 and 3 as well as between 2 and 4 are not revealed 
In the corresponding NR test results patterns. Second* since means are 
standardixed as well, any true sktU patterns charactertxed by differing 
levels of overall proficiency on two or more akiiis (I.e., high between-skill 
variance) are adjusted on the NR test results pattern so that these differ- 
ing levels of proficiency are made equal (I.e., t>etween-ski:i va.iance Is 
reduced). This standardlxatkm of group means together with the stan-> 
dardixatlon of wIthin-test variance described above has the effect of elimi- 
nating the differences t>etween the true skill patterns of Examples 4 and S 
as well as t>etween Examples € and 7 of Table 2. It should be particularly 
noted that If thf correlation t>etween two language skills Is high, NR test 
results pattern will always show tow betwten-test variance in spite of the 
possibility that the true l>etween-sklll varlarKe m^y In fact t>e i^utte high 
(as In Examples % and 7 of Table 2): while If the correlation between two 
language skills Is close to zero, then the NR test results pattern will 
invariably show high t>etwe|n*test variance In spite of the possibility that 
the true between-skltl variance may In fact be quite tow (as in Example 5 
of Table 2). Thus, It t>ecomes apparent that while CR measures of Ian* 
guage skills have the potential to Kcurately refkct the true skill pattern 
of a group of language learners with respect to ;k numt>er of language 
skills, NR measures as well as any stattstkal techniques based on correla* 
tton coefficients arc seriously limited In this respect. The Implkatlons of 
these differences between CR and NR measures of language proficiency for 
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the development of working models of CC will be considered along with 
other factors In the next section. 

Interpretimy Patterns of Test Results : 
Seven iliusiraiive Examples 

We have new seen that there are five Important considerations which 
hifluence the Interpretation of the results of studies which attempt to 
describe and validate working models of CC. These Include (a) the Pear- 
son product-moment correlation coefHclent between two tests and Its Inter- 
pretation (b) the language background pattern of the examinees, (c) the 
amount of withln-skill variance In language proficiency, (d) the amount of 
between-sC<IM variance In language proficiency, and (e) the type of tests 
used to obtain measures of language proficiency (NR or CR). We wUI now 
begin a systematic examination of how combinations of these considerations 
cm affect our interpretatton of the results of studies which ^attempt to 
oescrlbe and validate working models of CC. 

To <J0 this ^we will again use the simple situatton of a group of E3L 
learners who have been administered only two tests— tests of English 
speaking and reading comprehension. We will also continue to use Table 2 
wnich shows seven examples of combinations of withln-sklll variance 
bctwcen-sklll variance, and between-sklll correlatkms as well as sImpllUed 
graphic illustrations of true language skill patterns, NR test results pat- 
terns, and both HR and CR Interpretations for each of the seven ex- 
amples. (The Importance of language background characterlstks will be 
considered later.) Note thai the essential difference between the true skill 
patterns and their respective NR test results patterns Is that the latter 
are based on standard scores which In effect equate the means and vari- 
ances of the two tests coosklered In each example when the^ are not 
already equal in the true skill pattern. The CR test results pattern for 
each example Is not shown In Table 2 since If we were In fact able to use 
CR language measures according to the dennltlon stated above, the resul- 
tant test patterns would be very similar to the depicted true skill pat- 
terns, differing only by measurement error. 

For the first four examples, there Is no difference between the NR 
and CR Interpretation of the test results with respect to the number of 
independent factors accounting for the test results. This ^s because In 
these four examples, high between test correlatten coefHcients are accom- 
panied by iow^ between-test variance (Examples 1 ( 3) and tow between- 
test correla.kMi coefficients are accompanied by blgh be'ween-test variance 
(F.xamples 2 ^ Therefore, regardless of which of these statistics Is 

used as a criterrtjn for the number of independent factors underiying ESL 
reading and speaking skills (the correlatten coefHclent for the NR Inter- 
•tatton and the between-test variance for the CR lnterpretatk>n). the 
interp*^l»tlon would be the same. 

For the Hfth example, however, the NR and CR Interpretations con- 
flict. The NR Interpretatton of two factors would be based on the low 
correlation coefficient between the two tests while the CR Interpretation of 
one factor would be based on the low between-test variance. From an NR 
point of view. It makes sense to say that since relative performance on one 
test does not predict relative performance on the other, there must be two 
Independent skills responsible for the NR test results pattern. However, 
this Interpretatton does not consider that In absolute terms there was very 
little beiween-skill variance to begin with. This Js taken Into account by 
the CR interpretation which would conclude that since alt the examinees 
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seem to be at the same general level on both language skills one aan«>rai 
proflclencv f«:tor likely underlies both skills. ^ ' 

J t^iV/ Interpretation of the sixth and seventh examples 

f ^r;**!"? due to the high correlation coefHcJent ^etwe^^^ 
we hivl hin? ^l!IE[?^L^Jr problematkr. in both of these cases 

Tn . ^.^ between-iklll variance since all examinees performed better 
.J:.!?'^'"^ speaking test In absolute terms? How- 

ever each examinee performed at the same relatlve . leve l on the two tests* 
In these caws both one- and two-factor TnTerpFetatlons appeaKto mak; 
some sense but neither Interpretatton akme appears to do ^stlce to tSi 
n^i" ^JL^IV ^ S'^'" ^^^^ tester Since NR literpretationl 

Siri " l^V.l*''"? '7 umkHJbtedly more common (since little else Is 
li^ult t.*^ literature), most readers would likely be Impressed with 
. '^■;!?.V «>rr«>tk)n and olve any Interpretation other than a 
v.r^n;r« !^ ' "J* Ntvertheless, the high be^een-test 

variance must be taken Into account If CR language tests were used whteh 

H^Tl IP^' .IT* ''^l" ^''^"^ P?ofI?l.ncy In the tlS^skms. 
wot to do so would m«an neqlectlny tne Important Hndlngs that for the 
group under examlnatkm, native-speaker level proftelency In reading ESL 
Is not associated with natlve-spaaker level proficiency In speaking ESt. 
Obviously, something more Is Involved In speaking - iomethfrig moFe than 
8 accounted for by simply saying that both skills are related to a single 
language proficiency factor. Perhaps It could be said that fbr the sixth 
Jl^ikes tre"Jll»i?SeV '"^ one-and-a-half factor lnterpretatk)n 

Now, how do language background factors affect theso seven :ilustra- 
1 !r..'*^\"Ifr''^ A' tarller, a one-factor HR InterpreUtbn of lan- 

guage skills would seem to be !ess than convincing If based on data from a 
group having a high correlatton between exposure to the ESL skills belna 
f«:^!lLV^^^ Interpreta^Son of la^igu^e skX 3 

seem ifl-foonded If based solely on data from a group with m km betvvcen- 
sklll correatlon In exposure. With respect to Table 1, all one-factor NR 
Interpretations of test result patterns would be most convincing If based 
from group* similar to those shown In .Examples 2, or 5 while 
ail NR multi-factor Interpretattons would be best founded on data provided 
by groups slm';^r to Examples 1, 3, f or 7. If, however, we make um of 
CR language measures and wish to make CR Interpretatk^ns of test result 
pa. erns based prknaHly on the amount of b^tween-sklll variance In test 
results, then a one-factor Interpretatton would appear to be best founded 
f b4ied on groups whkh had high between-sklll variance In exposure to 
langm^e skills (as In Examples 2, ^, «, and 7 of Table 1) while a multi- 
factor lnterpretatk)n would appear to be most convincing If based on 
groups having low between-sklll variance In exposure to language skills 
^' ^' '"^ ' °' Important to keep In 

mind that data and Interpretattens obtained from one group cannot be 
generatlxed to other groups unless a strong case can be made that the 
grotips c»^re a common languaqe background pattern. 

Am ,fier thought whteh this discussten brings to mind Is that It may 
bo senseless to speak of a model of second-language CC without reference 
to a particular group of second tanguaoe learners. Surely, for many 
foreign students who enter Amertean colleges and universities, different 
aspects and modalities of ESL skills may be highly correlated lendlna 

fSSM^^'V ■ '^•J O"*'"' Oiler % Hfnofotis, 

19S0). However, this »'ertalnly does not necessarily Imply that there .ire 
i»*-»t many Individuals who are much stronger In some skills or aspects of 
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skills than In others. Indeed, no one would argue that tlitrt are not 
H«ny Individuals throughout the world who can s^eak a ,econ5^|,Vguagi 
and yet no read a word of It or others who can rUd materials In a second 
language with little dlffteuity yet can hardly utter a word o the 
itt ^^rjr" ^'>^'"^"^^»'>f^. ll would aplSTar, ci^'se&I?! 

h2L^?n^ f""? "l^r '"^"«'9»«« «he relattonship of languag^ 

background factors to second language proficiency rather than attemot to 
derive general models of CC t>ased on groups of learners wl^se second 

stSr''Addl1?nn,r''*,'r r"""*" or%cull.r to the"gr"p und"er 

study. Additional points relevant to this discusston will be made In the 

^r.« Vf'*rr ""J"? »°7« Influential reseTreh In hJ 

th's pair? '»"9"»9« «"«lng In light of the considerations raised In 

A Review of Selected Studies 

.i^ii", "11 Pr«=«'*'"9 sections, all illustrative examples were kept as 

„~«.H .Ki'.*^"""*' ^ «" show that the considerations ex- 

pressed in this paper do have an important bearing on actual empirkai 

Iniluentlal research in these areas will now be reviewed 

coll«rZvW.'"nr. 7'*^' °' emplrkal research designed to systematically 
collect •vidence for a general language proficiency factor is that of Oiler 
n»7«). In this research. Oiler administered a large tMtterv of ESL tests 
o foreign students enroll at th*. University of ?allfornla,Vos Angilej 
In spite of the fact that the tests administered had been designed to 
measure different aspects of ESL proficiency (e.g., vocabulary a?ammar 
reading dtetatlon. and clo« ability). It wis f,;?,^ that the bitwwn-twi 

htaL ora slniu'LMo'r"'*', ""••.''"?"•!>'• '"d'vWwl ttsts ail loaded 
mgniy on a single factor of a principal components analysis (a form of 

™„l.i..?.". ''•m'- «nclusk,n that these fInXgs 

constitute evidence for a single general language proficiency factor, hoW- 
ovtr, we need to examine Informatton concerning the types of tests used In 
this research and the language background o^hV pir^ci^tu" sublects? 
I mJ''* '•"9u»9e tests used In this research are described in some detail 
t .^'h' ""^ Strelff (IJ75). It hT clear f,^ ??e,e de- 

rxattteni'''*.*i'J"u Ji".'* I"" '""P"-'* "CLA ESL Proflclenc^ 

examlnatten) were des^ned to be norm-referenced measures of ESL pro- 

yfrti^^ Jt L AJ^li':*^*,^^*^'''''^''^ !" P"^"* Inter-lndlvldual 
variance but not designed to yield scores which are meaningful with re- 

-sptct_ -to-anr crlterton-ievelTjf-languagB proficiency. With respecf to the 

ESL background of the sub)ects, however, little Information is given. Had 

.if.'7h'r ^K'*'lJ '« '"'9h« be reasonable to assume 

'?,„, '"7 ■ homogeneous language background (I.e., low wlthln- 

exlur'. ?n".i" ""t""'' elthtr even (ISlriy equal 

oM^-T.- Pf communicative, competence In En- 

glish. I.e., low between-sklil variance) or uneven (unequal exposure to 
h^H%h°"T'"**V b««ween-skiil variance).' On the otKr hand? 

.L™!? ' ^""'"V countries, a heterogeneous languane 
background would be more likely (I.e., high withln-sklll varlanr* nn 
exposure to ESL skills). UnfortuwlW/thls'languSriJi^kUunr^n^"? 
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data then the one-factor Interpretatton given by Oiler n«v wlil ll »hl 
most reasonable. If, however, the true skill Miiern r?^h. i .k 

{w^°''as'''d\^i:!{»4 iirorthM^^^^^ 

"•^•^••'•••i* -PPV^rlate'^sInc!?^; the sta' ?stLal'rnaK"e's 
X ^lu^si?"'"^:'..''"''' relationships of res"?i of ,|| 

Sts li d«'r L .^J! f'"^""* »'hile the NR Interpretatton of these 
results Is cleariy a one-factor one, the use of CR lanauaae to<t« mH th. 

Thtrt may bt tven mort rtason to suspect tha viHditv nf th* 
fKtor Interpretatton of these test data if w« JS^sWer the pro^ 
tanguage background of these students. If they had sharSd^a hetSnlL 
ous, even English language background l.e.!\lS wItWn-!km v^an« 
and low between-sklil varfance In exposure to ESL skMIs) then the reb* 
lively high between-test correlatton ^fHcients obtained In ^hese stud ei 
could very well have been due to the fact that those studehts who h^ 
nroV^l"'!...*.'' ^"S"**' "PPO'-tunlty to dre"p proflden?^^^^^^ 

IxMsure Jo*E Lnr"r^.''>'J^^^^ thosJ w^S h^ I.'" 

? "i"?' '^'.'^ of «he language 

^i!!?.„7..' "•"J* . nformatlon on the type and amount of these 

f„.r Vh,? SI reported findings. It should b« clear, how- 

Zln oMhrVsl^ts*.""'^""* '^'^^ • '"-P-- 

relatl^.'„f*V P«''"f»«'''"- Oil*-- "nd HInofotis (1910) examined the cor- 
OMH.^! ? rj""'^'" ■s'nilnisteret; \o foreign university 

Lm? concerning the divisibility components of ESL 

skills. The data reported In this study are uaVlku irlv lnf«r..lirt,. i„ .h.. 

anguage test result patterns and because CR tests iere used In of 

est dai/;„iuJ ''H'?*'^* background. It was found th^ ESL 

test data collected from a group of tSS Iranians studying at the University 

ency (from a NR perspective) than did data collected from a (pMisumably) 
-n^^-heerogeneous-group^f-fo-riigTrs^ 

sity. if the Iranian students In tlit Tehran study had taken the same 
general type of ESL courses but for varying lengths of time f lhen there 
Jkll^ .rn"',„"^h 'I'" ■'•^''"9'r Intercorrilatlons 'among eXure to Rwe 
skills than for the foreign students In the U.S. That the test results "f 
these two groups appear to resemble what we would expect from the?r 
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language bac'xground is an Indication that language background factors can 
have Important Influence on test result patterns and must be taken Into 
consideration when test result patterns are Interpreted to support either a 
one- or multi-factor view of CC, * 

In addition. Oiler and HInofotIs made use of the FSI oral Interview 
procedure to obtain CR measures of English Kcent» grammar » vocatHJlary. 
fluency, and comprehenston for students In tht Illinois study. The use of 
these CR language measures would have made It possible to get a clearer 
pteture of the true skill pattern of the students than that provided by NR 
measures. However, none of the statistical analysts used to analyxe these 
data was sensitive to the absolute level of proficiency Indicated by tht FSI 
scores. Instead, all analyses were based on statistical procedures which 
reduced between-sklll variance accompanied by high Intercorrelallons 
between test scores. It Is tharefort possible that a re*analysls of these 
data using a CR definition of between-test variance based on the original 
raw scores of the FSI subparts might reveal that the data were not as 
easily accountable for by a one-factor model of CC. 

The most recent empirical work on the factors of CC Is that of Bach- 
man and Palmer (1982). The work of Bachman and Palmer distinguishes 
Itself from other research done In the area for Its use of different statis- 
tical techniques (causal modeling and confirmatory factor analysis Instead 
of the more commonly used exploratory factor analytic techniques) and a 
very heterogeneous iample of ESL learners (representing ages from 17 to 
67 years. 18 different native-language backgrounds, U.S. residence from a 
few months to over 10 years, and formal as well as Informal ESL learning 
contexts). Although the statistical analyses used by Bachman and Palmer 
do appear to have considerable advantages over exploratory factor analytk 
techniques (see Oiler, 1981). these techniques nevertheless share the same 
limitation mentioned earlier of reducing between-sklll variance whkh Is 
accompanied by high intcrcorrelatlons between test scores. Thus, these 
techniques do not make It possible to detect any of the true-skill patterns 
shown In Examples ^, 6, or 7 In Table 2. This Is the case despite the 
fact that a number of the language measures used In this research (the 
three FSI ratings and possibly the three self-rating scales) yielded CR 
Information, 

It Is therefore difficult to know how to Interpret Bachman and Pal- 
mer»s analyses whteh suggest the existence of a general factor accompanied 
by two additional specific trait factors of CC. The fact that Bachman and 
Palmer used a sample of subjects whteh appeared consWerably more hetero- 
-geneous''fn-language-background-thanrthose*'lncluded*1trthe pr-evlous wdrk~ 
of Oiler and his associates alw> raises the possibility that the Inadequacy 
of one general factor to account for these results may have t>een at least 
partly due to language tMckground factors. If one general factor could 
not explain the pattern of exposure of these language learners to various 
FSL skills (as Is the cas'* for Examples^2 and ^ of Table t), then Is should 
not be" surprising to find lhat one general factor falls to adequately ac- 
count for their pattern of language test results. 

Concluding Remarks 

The arguments of this paper lead directly to the conclusion that In 
spite of the amount of thinking, research, and writing that has been done 
on CC. we still have but a very fuziy picture of an empirically based 



IS 



working model of the factors composing CC. It should be clear that If 
additional empirical research Is to further our understanding of tiie factors 
comprising CC, It must Involve the use of CR language measures designed 
to reveal the true skill patterns of language learners together with appro- 
priate statistical analyses and extensive language tMC kg round Information 
must be collected and considered In the Interpretation of the results pro- 
vided by these measures. 
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